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14 February 1977 


MEMORANDUM FOR: Admiral Turner 


1. While I am sure you are pressed for time, I want to 
make the attached documents available to you before our meeting 
Wednesday morning. They are: NIE 11-3/8-76; the agreement reached 
among Mr. Bush, Mr. Cherne, and General Scowcroft under which the 
competitive analysis experiment was conducted; the report of 
Team B on Soviet strategic objectives (The Pipes Report); and a 
draft comment by the NIO for Strategic Programs on the Pipes 
Report. 


2. As your time is limited, I would recommend that you 
_read the Key Judgments section of 11-3/8, Pages 1 to 15, and 
Chapter 1 of the Summary Estimate, Pages 16 to 24, Volume II 
of the estimate is a more detailed presentation and is still at 
the printers, as is Volume III, the Annexes, 


3. The rest of 11-3/8 and the documents relating to the 
experiment I am simply making available for your scanning. I 
have not included the two technical Team B reports, but they are 
also available if you wish to see them. 


ichard Lehman 
Deputy to the DCI for National Intellicence 


Attachments 
Distribution: 
- DCI Briefing File 
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THE WHITE HOUSE 
WASHINGTON 


PRESIDENT'S FOREIGN INTELLIGENCE ADVISORY BOARD 


8 June 1976 


Dear George: 


As you know, the President's Foreign Intelligence Advisory Board has 
long been concerned with the quality of National Intelligence Estimates, 
especially those dealing with the strategic c.pabilities of the USSR, 
These Estimates are perhaps the most imp:-rtant products of the 
Intelligence Community. Every possible scup should be taken to con- 
tinually improve their comprehensiveness, soundness and utility to 
the President and his senior advisors, 


Over the past year, the Board's continuing concern with this subject 

has been a matter of special interest and resulted in the establishment 

of an Intelligence Estimates Evaluation Committee chaired by Robert 

W. Galvin, assisted by Dr, John S. Foster, Jr., Dr. Edward Teller 
and recently Mr. William Casey. The full Board has discussed its 
perceptions with the President and Mr. Colby and the Committee has 
advanced this dialogue with members of your staff responsible for the 
production of strategic force estimates, We think these discussions have 
been productive and look forward to sustaining them as we work together 
toward the common goal of better NIEs. 


One recommendation the Board has rnade, and which its NIE Pyaluation 
Committee has refined, is that an expeziment in competitive sanz 


undertaken in connection with the production of this year's estin 
Soviet Forces for Intercontinental Conflict: NIE 11-3/8- Ges ee DUrhOss 
of the experiment is to genern'c, sot : i i 
available, poszible alternative descrip: 
of Soviet activities, capabilites and chic 
experiment with your Deputy tor Nation 
light. of those discussions, we jointly pr 
to guide this experiment, 
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(1) NIE 11-3/8-76 itself will be prepared by the Intelligence 
Community in accordance with the work plan developed by the NIO 
for Strategic Programs, For the purposes of this letter, those 
working on NIE 11-3/8-76 will be referred to as the "A Team," 


(2) In the preparation of this NIE, key uncertainties iden~ 
tified by, and divergent opinions arising within the Intelligence 
Community will be clearly presented, using techniques of presentation 
familiar to readers of the Estimate as well as any new techniques 
the Intelligence Community may find desirable. 


(3) In addition, with respect to certain key issues, an experi- 
ment in the technique of competitive analysis will be conducted. 
Candidate issues for this experimental treatment include Soviet 
ICBM accuracy, low-altitude air defense capabilities, Soviet 
strategic objectives, etc. Three such issues will be selected by the 
DCi in consultation with the Assistant to the President for Natronal 

‘Security Affairs. 


(4) On each of the three issues. selected for the experiment, 
the DCI, in consultation with the NIE Evaluation Committee, will 
select a "B Team" of appropriate size. The members of the three. 

"B Teams!" will be persons inside or outside the Intelligence Com~ 
munity and the Government, who have expert knowledge in the subjects 
in question, who have (or can be granted)the necessary clearances, — 
but who are not themselves engaged in the production of the NIE, 


(5) In their respective areas, each of the three B Teams will 
work independently of the NIE 11-3/8-76 A Team, Each B Team, 
however, will be given access to all of the information on its area of 
corcern available to the US Government, i.e., it will have access to 
the same body of inforrnation and data on the issue which it is to 
address as is available to the A Tearn, Also, each B Team will adhere 
to the A Tearn's production schedule so that the three B Teams! drafts 
of their respective indepondent assess-naents are completed at the 
same time that the basic estimate (A Tosm) draft is finished, 


(6) Once all drafts are Sempplesee: the A Team and the overall 
managers of the Estimate will be given access to the three 6 Teams' 
drafts, and each B Team will be saieied access to all portions of the 
basic Estimate draft relating to that B Team's area of concentration, 
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(7) Each B Team will then meet with members cithe A Teara 
to discuss their respective findings and conclusions. These dis- 
cussions will not ~~ repeat not ~- be ainied at striking compromises 
or reaching consensus judgments, Their purpose, ae eae will be 
to ensure that both the A Team and the B Teams are, having been 
motivated to construct alternatives, compelled to-defen< Ae 
assertions and their use of evidence and analysis fer one: peers 


equally well versed in the technical details of their respective subjects. 


a ¥ 


(8) After these discussions, both the A Tearn and the B Teams 
will have an opportunity to revise their drafts to the extent that they 
care to make such revisions. 


(9) The three B Teams will then prepare written comments 
on the portions of the revised basic Estimate draft dealing with their 
respective areas of concern, Similarly, the A Team will prepare 
written comments onthe three revised B Team draits. 


ne .(10) The entire package ~~ basic Estimate draft, the three 

-B Team drafts, andthe comments of A and B Teams -- will then be 
studied by, briefed in detail to, and discussed by the National Foreign 
Intelligence Board, chaired by the DCI. Once again, the purpose of 
this discussion will not -- repeat not -~ be that of effecting compromises 
or reaching consensus judyments. Instead, it will be to ensure that 
the evidence and the possible alternatives and analyses of all parties 
are on the table and open to challenge. 


(11) The final Estimate will be issued, as usual, dy the DCI. 
The three B Team submissions will be forwarded with if to selected 
recipients including the Assistant to the President f j 
Security Affairs andthe PFIAB. The sevarate, expe 
containing these submissions will also reproduce 
the A Team analyses of the same subjects and will co 


the comments of the A and B Teams on gach others’ submissions 
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(iz ter NIE 11+3/8-~76, 2ion: 
Ls er “tye Assistant to the President for N 
Affairs, in consultation with the DCI andthe P 
panel of senior consumers, civilian and military, to review the 
experiment and critique its results 
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The cooperation of your principal assistants in this area has been 
exceptional, The entire Board is impressed with the intensity of 
their motivation to seck and try out new ways of improving the esti- 
mating process and thus the intelligence product which is provided to 
the national leadership. 


25X1 


Chairman 


The Honorable George Bush 
Ditector of Central Intelligence 
CIA Headquarters Building 
Washington, D, C. 20505 
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